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Abstract — We consider the design and analysis of coding 
schemes for the binary input two way relay channel with erasure 
noise. We are particularly interested in reliable physical layer 
network coding in which the relay performs perfect error cor- 
rection prior to forwarding messages. The best known achievable 
rates for this problem can be achieved through either decode 
and forward or compute and forward relaying. We consider 
a decoding paradigm called joint compute and forward which 
we numerically show can achieve the best of these rates with a 
single encoder and decoder. This is accomplished by deriving the 
exact performance of a message passing decoder based on joint 
compute and forward for spatially coupled LDPC ensembles. 

Index Terms — Network coding, two-way relaying, compute- 
and-forward, decode-and-forward, density evolution, spatially 
coupled codes 
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I. Introduction 

We consider the two way relaying channel in which node 
A has data to send to node B and vice versa. The relay R 
is included to assist in this communication, and there is no 
direct link between nodes A and B. Let Uj^,Ug G {0, 1}^ 
be the binary input message sequence^ which are encoded 
into length N codewords a;^ G Ca and Xg E Cb- The 
relay observes the output of a memoryless multiple access 
channel (MAC) P{Yr\Xa,Xb)- The objective of the relay 
is to reliably decode the message = © Ug which 
is encoded and broadcast to nodes A and B. This is shown 
in Fig. [T] We define the achievable computation rate TZ as 
the largest ^ such that can be decoded reliably in the 
usual information-theoretic sense. We focus specifically on the 
achievable computation rates of Low Density Parity Check 
(LDPC) code ensembles and message passing decoding. 

A natural solution to the aforementioned problem is to treat 
the channel as a multiple-access (MAC) channel. Then, two 
independent codes Ca, Cb can be used such that £ Ca 
and Xg £ Cb can be fully decoded at the relay. The relay 
can subsequently recover u^. This scheme, called decode and 
forward (DF), can achieve all rates subject to IT) 

TZdf < mm{h{YR; Xa, Xb), I{Yr- Xa\Xb), 

I{Yr;Xb\Xa)). (1) 

This work was supported by the National Science Foundation under Grant 
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' We use underlined vectors like x to refer to symbol sequences, and we use 
X or X [n] to refer to an arbitrary element or the nth element of x, respectively. 



Fig. 1. System model showing a of two-way relay channel with PLNC. 

When the two codes Ca and Cb are identical linear codes, in 
111, we showed that the following rates are achievable 

n'oF < mm{nDF,I{YR;XA,XB\XABB)}- (2) 

A different strategy called compute and forward (CF) be- 
came popular in research because of the idea that it is wasteful 
for a relay to reliably decode each received message ||3l, Q. 
In CF, nodes A and B use the same linear code C, and the 
relay directly computes 

N 

^m^CFilR) = argmax J| P{yB[n]\x(^[n]). 

^®^'' n=l 

= arg max ^ P{y^\xA,x 

^e^'^ {^^,3;Be{o,i}"l3;e=^iAffii?iB} 

(3) 

CF can achieve all rates subject to 

-RcF <I{Yr-X^). (4) 

This decoding structure performs well when P{Yfi\XA,XB) 
is matched to X® in some sense jSl. According to 
P{Yii\Xa, Xb) is ideally matched to if the channel satis- 
fies P{Yr\Xa,Xb) = P{Yr\Xa®1,Xb®1) ^ P{Yr\X^). 
A CF decoder assumes ideal matching which means that it 
effectively performs error correction on elementwise estimates 
P[Yr\X^). 
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When P{Yfj\XA, Xb) and X© are poorly matched, the 
information lost by operating on the estimates P{Yfj\Xc^) 
is significant (i.e. P{Y]i\X(^) is not a sufficient statistic). 
Therefore several schemes which perform message passing 
decoding with larger message alphabets have been proposed 
lIU, Q, lis), S. We refer to the decoding paradigm used in 
these papers as Joint Compute and Forward (JCF) and we note 
that this decoder attempts to solve the following problem 



state T is parameterized by an erasure probability e e [0, 1]. 
Thus the channel is defined 



,,JCF 



arg max 



E 



(5) 

Note that the summation is taken over the set of codewords 
C instead of the set {0, 1}^ as in ([3|. Comparing ([sj and 
(|5]l, it is clear that the JCF decoder is better than the CF 
decoder. Indeed, there are simulation results in |6|, [7|, [8 1, f9l 
which indicate that with JCF, higher computation rates than 
those achievable with the CF strategy in (|4| can be achieved 
for certain channel parameters. However, the results in [6], 
10 > IEIj li9J are based only on simulations and provide little 
insight into the operation of the JCF decoder. Particularly, the 
relationship between TZdf, T^cf, and the rates achievable 
with JCF is not clear. This is because it is difficult to develop 
analytical results for the JCF decoder 

In this paper, we introduce a class of two-way erasure mul- 
tiple access channels (TWEMAC) for which we can exactly 
analyze the performance of the JCF message passing decoder 
Specifically, we derive the exact density evolution equations 
and compute the corresponding thresholds for LDPC code 
ensembles with JCF message passing decoding. For a given 
set of channel parameters, we numerically show that spatially- 
coupled LDPC codes when decoded in this way can achieve 
all rates subject to 



TZjcF < ma,x{TZDF,'R'CF}- 



(6) 



For any binary input memoryless MAC channel, it can be 
shown that max{7?.'^^, 7?.cf} — ^sx.{T^df,T^cf}- The 
proof of this must be omitted for space. This means that the 
JCF decoder naturally performs as well as the better of the 
DF and CF schemes. 

Finally, we show that the class of punctured spatially- 
coupled LDPC codes can be used to obtain a rate of 
max{TZDF ,T^cf} over the entire range of channel parame- 
ters, i.e., it is not required to use different degree distributions 
of LDPC codes for the different rates and channel parameters. 
It suffices to use a single spatially coupled LDPC code and 
puncture this code until the rate is close to ma.x{TZDF;Ti-CF} 
for given channel parameters. 

II. Channel Model 

We introduce the TWEMAC channel model and character- 
ize the performance of iterative decoding of LDPC ensembles 
over the TWEMAC. We introduced a special case of this 
channel very recently in |10|. A TWEMAC is randomly in 
one of five states r e T — {!,..., 5} during each channel use. 
The value of yn is a deterministic function of xa,xb and the 
state T. In this paper, the probability pr that the channel is in 



{E,E) 
{Xa,E) 
{E,Xb) 
{Xa®Xb) 
{Xa, Xb) 



with probability 
with probability 
with probability 
with probability 
with probability 



P2(e) 
P3(e) 
P4(e) 
P5(e) 



(7) 



where E denotes an erasure and 'J2i=iPii^) = 1 V e G [0, 1]. 
The state of the channel is assumed to be known to the relay 
but unknown at nodes A and B. 

Since we are interested in message passing decoding, it is 
useful to refer to the messages from the channel as having a 
message type from the set T- Then messages passed along 
the edges in the decoder will also have a type from the set 
T. We define the type distribution vector for a given channel 
according to 

Pcki^) = [pi{e),P2{e),P3{e),p^{e),p,{e)f (8) 

where the subscript ch associates this type distribution with 
the channel output. The class of TWEMACs has the advantage 
that the probabilities Pt,t E T can be chosen in order to 
mimic or isolate many characteristics of wireless channels. 

For this paper, we will present numerical results for the 
TWEMAC parameterized by 

P,,(e)= [e^(l-e)e,6(l-e),(l-e)^0]'^. (9) 

This channel is generated if we assume that xa and a;^ are 
erased with probability e independently. When neither symbol 
is erased, the relay observes the type 4 message x®. When 
XA (xb) is erased and xb (xa) is not, we receive a message 
of type 3 (type 2). This channel mimics the effects of deep 
fade events for a wireless channel. The channel coefficients 
can be either 1 or 0, and when both channels are strong, the 
matching for the channel is ideal. We fix P5(e) = so that 
the change in matching quality with e is more pronounced. 

III. CF AND JCF Message Passing Decoders 

We consider the case where Xj^,Xb G C so that the 
codewords are members of identical linear LDPC codes. By 
the linearity of C, we have G C. The constraints associated 
with G C can be described by a Tanner graph with variable 
nodes x^ln] G {0, 1}. A decoder which directly decodes 
by passing messages in this Tanner graph is a CF message 
passing decoder. 

In addition to the G C constraints, a JCF decoder uses 
the constraints associated with G C and Xb G C for 
decoding. All three of these constraint sets can be jointly 
expressed by an Extended Tanner Graph (ETG) as shown in 
Fig. |2] Therefore, the decoder which decodes x^ by passing 
messages on this ETG is a JCF message passing decoder. In 
the ETG, each variable node XA,B[n] — [xa["], 2;b[77]]-^, n G 
{1, iV} takes a value from {0, 1}^. The edges carry A — ary 
messages which are local estimates of XA,B[n] of the form 

PiXAAn] = m^\yR) 
p{XAAn] = [W\yR) 
p{XAAn] = [iiV\yR) 



(10) 
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Node A Tanner Graph Extended Tanner Graph Node B Tanner Graph 
Fig. 2. ETG when nodes A and B use a (3, 1) repetition code. 
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TABLE II 

Check node operator table with respect to types T. 



A rigorous derivation of the message processing rules for 
the JCF message passing decoder must be omitted for space, 
however these rules follow directly from ifTTI . 

While the messages passed along the edges in the ETG are 
4-ary messages, to characterize the performance of an LDPC 
ensemble with a JCF message passing decoder, it is sufficient 
to think of these messages as being one of the 5 types from 
the set T ■ For example, if /i„ = ^ 0]"^, this essentially 
corresponds to ["] being perfectly known and [n] being 
unknown or, equivalently, erased. Hence, we can think of this 
as being a message of type 2. In this paper, we use the latter 
representation as this will make it more convenient to analyze 
the decoder. 

The input output relationship for message types T at the 
variable and check nodes can be obtained from the message 
processing rules for the 4 — ary estimates of each XA.B\n\ as 
follows. 



VAR 


^1 


1 


2 


3 


4 


5 


in 
^2 


1 


1 


2 


3 


4 


5 


2 


2 


2 


5 


5 


5 


3 


3 


5 


3 


5 


5 


4 


4 


5 


5 


4 


5 


5 


5 


5 


5 


5 


5 



TABLE I 

Variable node operator table with respect to types T. 



Consider a degree d^, variable node which is connected to d„ 
check nodes and one function node associated with the channel 
observation. Thus, each output message from a degree c?„ 
variable node is a function of input messages. For a variable 
node of degree d^ = 2, the type of the outgoing message 
T°"* is a function of the types of the incoming messages, 
namely ri and t^. Let this function be denoted by V AR, i.e., 
T°"* = VAR{ty,T2). The function VAR is defined in Table 
|l] For a variable node of degree c?„, if the input messages 
have types Ti,...,Td^, then the output message type is found 
by recursively applying VAR{-, •) according to 

T™* =FAi?(Tl,yAi?(T2,...FAi?(Td„_l,rdJ)). (11) 

A degree dc check node is connected to dc variable nodes. 
Thus, each output message for a degree dc check node is a 
function of dc — 1 input messages. For a check node of degree 
dc — 3, the type update operation CHK{t"^ ,t^) is defined 
in Table If the input messages to a check node of degree 
dc have types ri, r^^-i, then the output message type is 
found by recursively applying CHK{-, •) as 

T°"* = CHK{Ti,CHK{T2,...CHK{Td^.2,Td^-i))). (12) 



IV. Type Distribution Evolution 

For the normal binary erasure channel, the asymptotic (in 
length) performance of an LDPC code or ensemble is often 
analyzed using the idea of density evolution ifTTl . The main 
idea in density evolution is to compute the probability that a 
message from a variable node to check node (or check node 
to variable node) is erased during the Ith iteration. In this 
section, we characterize the performance of LDPC ensembles 
using JCF message passing decoding for TWEMACs. Analo- 
gous to tracking the probability of erasure we will track the 
distribution of message types sent on a randomly chosen edge. 
Hence, we refer to this performance characterization as type 
distribution evolution. 

To be consistent with much of the literature, each variable 
node is initialized (iteration 0) with the observation from the 
channel and forwards this message to all connected check 
nodes. The check nodes process these messages and forward 
their estimates back to the variable nodes. This process contin- 
ues until the iterations reach a fixed point. As in ifTTl . we work 
under the assumption that, for a finite number of iterations and 
for some N large enough, the local graph around any variable 
node is a tree with high probability. This allows us to assume 
that the type distribution for each input message to a variable 
or check node is independent from the other input messages. 

We have defined the input output relationship for variable 
and check nodes on the set T. Here, these rules are extended 
to the set of 5— ary type distributions. Similar to (|8]l, we define 
the type distribution of messages from the variable to check 
(check to variable) nodes during iteration £ as P^^} )■ We 
will index these pmfs according to 



P 



pl,{e) p2,(£) p3,{£} p4,(<!) p5,{l) 

^ VC f VC ' VC 1 VC 1 vc 

pW ^ pl,W p2M) p3,(«) p4,(f) p5,(£) 



(13) 



It is helpful to think of the variable node operation on 
the set of type distributions in terms of the probabilities of 
an initial state, given by P f^, and a subsequent transition 
probability, determined by PcJ ^"d Table nlThis is illustrated 
for a degree d^ = 3 variable node in Fig. [3] The distribution 
for the initial state is given by the channel type distribution 
Pch- Then, there are two input messages from check nodes 
whose type distributions are applied in the form of transitions 
through the trellis. These transitions are labeled according to 
the message types r € T which correspond to the labeled 
transition. The probability associated with each transition is 
therefore the sum of the probabilities of the corresponding 
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Fig. 3. Trellis diagram type distribution update for a degree 3 variable node. Fig. 4. Trellis diagram type distribution update for a degree 4 check node. 



types (e.g. the probability of transition from type 3 to 5 is 



p2,(f) 



p. 



4,W 



It is efficient to express this type distribution update opera- 
tion in matrix form. For a degree 2 variable node, we have 

Pi'l = Pi'JPc,- (14) 
The {i,j)th element of the matrix P™ is defined 

^''^ {feer I i=VAR{k,j)} 

where the elements of the summation follow the rules given 
in Table |l] The notation P(j — > i) refers to the probability of 
a transition from type j to type i as depicted in Fig. |3] 
This is equivalent to 
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^ cv 
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^ CV 





pl+2,(f) 
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J^cv 














p5,(£) p3+4+5,(f) 
-'CD c't; 



2+4+5, (^) p2+3+5,(£) 



where the shorthand Pr 



P 



P«,(^) 



p 



For a variable node of degree dv > 2, the type distribution 
update equation can be stated as 



P 



-ch ■ 



(16) 



To see this, note that similar to multiplying P^/j, the 



matrix element 



^ r.v -t ■ 



cv ^ cv \ is defined by 



J i,k — 

3 



(17) 



The check node type distribution update operation is similar 
The trellis structure for a degree 4 check node is depicted in 
Fig. |4] where the transitions are arranged according to Table 



III The state transition matrix P^l^ is defined 
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> 2 check node is 



(18) 



The update equation for a degree dc 
therefore given by 

—cv \ vc } - 

The state transition matrix Vvc is raised to the power dc — 2 
because one of the input edges is forms the probabilities for 
the initial types. The remaining dc — 2 input edges are applied 
in the form of the state transition matrix (i.e. they form the 
transition probabihties in the trellis of Fig. |4|l. 

A. Type Distribution Evolution for Regular Ensembles 

For a {dy,dc) regular ensemble, we assume that the in- 
coming messages to a variable or check node are distributed 
according to P'^j or P[f} respectively. Since the first message 
from the variable to check nodes is the message from the 
channel, the type distribution evolution is initialized by 

p(0) ^ p 

—vc —ch 



(19) 

For every iteration £ > 2, the type distribution evolution is 
fully characterized by 



If we allow the decoder to complete imax iterations, the 
type distribution at the output of the decoder is 

ZitH- (Pii"°-^)'>c/.- (21) 

The objective of the relay is to recover the codeword x^. 
Therefore, the bitwise probability of successful computation 
after imax iterations is defined by 



Pl 



P 



4,(«„ 



P 



5,(^™a.) 



(22) 
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This is because the value of is known if the decoder output 
is either type 4 or 5. We define ethesh as the largest e such 
that reliable decoding is possible for an LDPC ensemble (i.e. 

Pdec > 1). 

B. Type Distribution Evolution Spatially Coupled Codes 

In this section, we characterize the performance of spatially 
coupled LDPC codes. Since node A and B each use the same 
spatially coupled LDPC code, the ETG used for decoding 
at the relay is also spatially coupled. The common method 
to achieve the capacity of a given channel is to find some 
distribution on the variable and check node degrees such that 
a message passing decoder can reliably decode at rates near 
the channel capacity. It has recently been discovered that for 
spatially coupled LDPC ensembles a message passing decoder 
can nearly achieve the performance of an optimal decoder lfT2l . 
ifTSJ . This holds for a large class of binary input channels lfT4l . 

m. 

Therefore, we extend our type distribution evolution analy- 
sis to the {dy,dc, L,w) ensemble which is defined rigorously 
in ||T3l . In this ensemble, M variable nodes are placed in 
each position i S {—L,...,L} so that the codeword length 
is TV = (2L + 1)M. Each variable and check node has 
degree dy and dc respectively. There are Md^ edges in each 
position which requires that check nodes be placed 

at each position. These check nodes are placed at positions 
i e {—L,...,L + w — 1}. The ensemble is constructed by 
uniformly and independently connecting the d^, (dc) edges 
from a variable (check) node at position i to check (variable) 
nodes at positions {i, i + w ~ 1} ({i — w + 1, i}). All 
check node connections to variable nodes outside of positions 
{—L,...,L} are connected to pseudo variable nodes whose 
value is fixed to xa.b = [00]^. This decreases the effective 
degree of these check nodes. 

The nominal rate for a {d^, dc, L,w) ensemble is defined 



-L — w + 



dv 



dy w +i-2j:t,ii) 

dc 2L + 1 



Tl{dy,dc,L,w) = 1 - 

Uc / Ujc i 

(23) 

This is a lower bound on the actual rate, however, it approaches 
the rate of the regular ensemble 7l{dy,dc) = 1 — ^ as 
L — >^ cx) for a fixed w. This ensemble is primarily useful 
for information theoretic proofs. A protograph diagram for a 
{dy,dc,L — 5,w — 5) ensemble is shown in Fig. |5] with 
variable and check nodes depicted by circles and squares 
respectively. The dashed edges depict possible connections to 
pseudo variable nodes which will always give a message of 
type 5. Note that each edge in Fig. [5] represents a possible 
edge for a node at the given position. Particularly, a specific 
check node at position —L might only have connections to 
pseudo variable nodes. 

To characterize the performance of this ensemble, we need 
to track the type distribution for the nodes in each position 
separately. We define the type distribution for messages from 
the output of a variable node at position i to any check node as 

Pyci- define the effective input message to a check node 

(I) 

at position i as P_yci- We similarly define PcJi and P_cv i- 




-L L L + w - 1 

Fig. 5. Protograph diagram for a (d^,dc,L = 5,w = 5) code ensemble. 

The effective input messages are calculated by 

P^.-l; E zS,V^e{-L,...,L} 

w ^ — ^ 

1 * 

^ Pi2,y ^e{-L,...,L + w-^}. (24) 



—VC.l 



j—i—w-{-l 



The type distribution evolution for the (dy, dc^ w) ensem- 
ble is initialized by 

^(0)_r y^e{-L,...,L} 

-"^•'^ \ [00001]^ Vz^{-L,...,L} • ^ ' 

Then, the type distribution evolution for this ensemble is 
fully characterized by 



FOR £ = 



P 



\ vc,i I 



p 



p 



i e {-L,...,L + w - 1} 
(26) 



where ( |24| ) is used to determine Pcv i and -Pyc ^ as needed. 
Similar to ( |2T| l, if we allow £max iterations, the output type 
distribution for a variable node at position i for this decoder 

is 

p(f™..) _ /p(«™„x)\''"p (27) 

Similar to ( |22] l, the bitwise probability of successful compu- 
tation for a variable at position i is 



Pdec.i — Pf 



(28) 



We define ^thresh as the largest e such that reli- 
able decoding is possible for this LDPC ensemble (i.e. 



™^ie{-L,...,L} Pdec,i 



-> 1). Notice, that we are already 



considering the case that M is very large. This type distribu- 
tion analysis defines the average performance of the ensemble 
of protographs defined by the parameters dc, L, w). 

C. Results and Discussion 

The rates TZcf, TIdf, and Tl'j^p are plotted along with 
numerical results for the thresholds obtained from type distri- 
bution evolution for a series of [dy, dc, L, w) ensembles in Fig. 
|6] Notice that TZ'up = TZdf whenever TZdf > Ti-CF- The 
check degree is dc = 10. The protograph length parameter 
is L = 4, 000. The smoothing parameter is w = 100. The 
variable node degree dy takes the values dy — 3,..., 9 so 
that the performance can be characterized for several rates. 
The maximum number of iterations is imax — 20, 000. Here, 
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♦ Punctured 
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Fig. 6. 7?-CF; T^DF^ '^'dF' numerical type distribution evolution 
results for {d„,dc,L,w) = ([3, 9] , 10, 4000, 100) and (d^,dc,L,w) = 
(9, 10, 10000, 100) for un-punctured and punctured ensembles respectively. 



^thresh is the largest e such that mini(z[_L^„,,Ly{Pdec,i} > 1- 
10~^. The nominal rate ( |23| l is plotted as a function of ethresh- 
Notice that for each ethresh, the achievable rate is closely 
upper bounded by the best of the TZcf and TZdf curves. 
This supports our claim that TZjcf = niax{TlDF,T^CF}- 
It is important to remember that the {dv,dc, L,w) ensemble, 
and the very large £max, is primarily useful for information 
theoretic analysis. More practical spatially coupled LDPC 
codes can be developed, and this will be the subject of future 
work. 

It has been shown that spatially coupled ensembles can 
achieve near optimal decoding performance for some binary 
input MAC channels universally |14|. This result coupled 
with (|6]l suggests that it is practically possible to achieve all 
points on the ma.x{TZDF,T^CF} curve with a single encoder 
and decoder using puncturing. We apply an identical random 
puncturing sequence tt at nodes A and B to adjust the rate of 
the transmitted codewords and Xg. Let p-„ = ^-j)- he the 
probability that a given ^^.^[n] is punctured. The positions 
of the punctured bits are selected uniformly at random. The 
decoder treats the punctured bits as type 1 messages. The 
effective channel can therefore be defined by 

pi(e)(l ~p^) 
P2(e)(l -Ptt) 
P.h,.^ P3ieKl-p.) ■ (29) 
P4(e)(l -Ptt) 
P5(e)(l -Ptt) 

The rate of a channel code is defined as the number of message 
bits K divided by the codeword length N. Thus the rate of a 
code after puncturing is given by 



K 



N{l-p,) 



1 



(30) 



The puncture adjusted rate TZy^ is plotted as a function of 
^thresh in Fig. |6] The punctured ensemble parameters are 
(dy,dc,L,w) = (9,10,10000,100) which is a low rate 



ensemble. The type distribution evolution algorithm in p6l ) 
was allowed to run for imax — 400, 000 iterations. Notice 
again that for each ethresh, the achievable rate is closely 
upper bounded by niax{TZDF,Ti-CF}- This means that the 
whole known equal rate region can be achieved using a single 
encoder and decoder at each transceiver. 

V. Conclusion 

We have numerically shown for some channel classes that 
JCF message passing decoding performs as well as DF and CP. 
We have derived a flexible class of channels for prototyping 
code designs. We have provided exact density evolution anal- 
ysis for LDPC code ensembles for this class of TWEMACs. 
The universality of spatially coupled codes allows a single 
encoder and decoder to achieve any currently known equal 
exchange rate. This is an exciting problem which deserves 
further investigation and rigorous analysis. 
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